PyDigger - unearthing stuff about Python


NameVersionSummarydate
rs-bpe 0.1.0 A ridiculously fast Python BPE (Byte Pair Encoder) implementation written in Rust 2025-03-19 05:58:24
kitoken 0.10.1 Fast and versatile tokenizer for language models, supporting BPE, Unigram and WordPiece tokenization 2024-12-20 03:07:14
hourdayweektotal
6013358021295380
Elapsed time: 2.13300s